Many organizations have started to build infrastructure for AI using IBM Power Systems, which leverage NVIDIA GPUs. Enterprises often focus on building AI solutions that provide high availability, automated orchestration and the like, which can add to the cost of the solution. Educational institutions and research organizations, however, often look for solutions that give them more flexibility in utilizing underlying resources optimally for their machine learning and deep learning (ML/DL) workloads, and with much lower costs. Researchers may require running parallel DL training jobs using different AI runtimes. Professors may require allocating and deallocating AI runtimes to multiple students for AI assignments.